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Abstract 

In this paper the set of value functions of all-possible zero-sum differential games 
with terminal payoff is characterized. The necessary and sufficient condition for a given 
function to be a value of some differential game with terminal payoff is obtained. 

1 Introduction 

The paper is devoted to the theory of two-controlled, zero sum differential games. Within the 
framework of this theory the control processes under uncertainty are studied. N.N. Krasovskii 
and A.I. Subbotin introduced the feedback formalization of differential games [If. This formal- 
ization allows them to prove the existence of value function. 

In this paper we characterize the set of value functions of all-possible zero-sum differential 
games with terminal payoff. The value function is minimax (or viscosity) solution of corre- 
sponding Isaacs-Bellman equation (Hamilton- Jacobi equation) [2]. 

One can consider a differential game within usual constraints as a complex of two control 
spaces, game dynamic and terminal payoff function. The time interval and state space of game 
are assumed to be fixed. In this paper the following problem is considered: let the locally 
lipschitzian function <p(t,x) be given, do there exist control spaces, dynamic function and 
terminal payoff function such that the function tp(t,x) is the value of corresponding differential 
game? 

2 Preliminaries 

In this section we recall the main notions of the theory of zero-sum differential games. We 
follow the formalization of N.N. Krasovskii and A.I. Subbotin. 

Usually in the theory of differential games the following problem is considered pQ. Let the 
controlled system 
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and payoff functional a(x($o)) be given. Here u and v are controls of the player U and the 
player V respectively. The player U tries to minimize the payoff and the player V wishes to 
maximize the payoff. The purpose is to find the value of corresponding game. The value is a 
function (p from [t , i? Q ] x R n to R. 

Suppose that P and Q are finite-dimensional compacts. The function / satisfies the following 
assumption: 

Fl. / is continuous; 

F2. / is locally lipschitzian with respect to the phase variable; 

F3. there exists constant A/ such that for every t G [to,$o], x G ^ n > u e P, v E Q the 
following inequality holds: 

\\f(t,x,u,v)\\<A f (l + \\x\\). 

Often the Isaacs condition is put: for any t 6 [to,^o], x G f", s 6 R n the equality 

min max(s, f(t, x, u, v)) = maxmin(s, f(t, x, u, v)) 

is valid. 

The function a : R™ — > R satisfies the following assumption (see [2], [3]): 
El. a is locally lipshitzian; 
E2. there exists A CT such that 

W(x)\ < A CT (1 + ||x||). 

Assumption El grantees the locally lipschitzness of value function. Assumption El is often 
replaced by the condition of continuity of a. Assumption E2 was used by A.I. Subbotin in his 
theory of minimax solution. It is not traditional for other approaches. 

We consider three types of control design [TJ. 

1. Player U chooses the control in the class of counter-stratagies, and the player V chooses 
the control in the class of feedback strategies. 

2. Player U chooses the control in the class of feedback strategies, and the player V chooses 
the control in the class of counter-stratagies. 

3. Isaacs condition is valid and players U and V choose the controls in the classes of feedback 
strategies. 

N.N. Krasovskii and A.I. Subbotin proved that value functions are well-defined in these 
three cases. Let us denote the value function in the first case by Var (•, •, P, Q, f, a), in the 
second case by Val s (-, ■, P,Q, f,a), in the third case by Val(-, ■, P,Q, f,a). It is well-known 
that value functions are locally lipshitzian under assumption F1-F3, El, E2 [3J. 

A.I. Subbotin proved that the value of differential game satisfies the boundary condition 

<p{0 o ,x) = <T(x) (2) 
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and the equation 

!W^ + H(t,x i V<p(t i x))=0 (3) 

in generalized sense. Here V x) means the vector of partial derivatives of (p with respect to 
space variables. 

H is called Hamiltonian of differential game. It is defined in the following way. 

• In the first case H is given by 

Hit, x, s) = H^~\t, x, s) = maxmin(s, fit, x, u, v)). 

veQ ueP 

• In the second case H is given by 

Hit, x, s) = H^ + \t, x, s) = minmax(s, f{t, x, u, v)). 

u<=p veQ 

• If Isaacs condition is valid, then H^ = H^ + \ Therefore, H = H^~' = H^ in this case. 

A.I.Subbotin introduced several definitions of generalized (minimax) solution of Hamilton- 
Jacobi equation [2]. He proved that they are equivalent. Also A.I. Subbotin proved that notion 
of minimax solution coincides with the notion of viscosity solution (see [2] and [3]). We use 
one of equivalent definitions of minimax solution. Function ip(t,x) is called minimax solution 
of Hamilton- Jacobi equation ([3]), if for every (t,x) G (to^o) x K n the following conditions is 
fulfilled: 

a + H(t,x,s) < V(a,s) G D~tp(t,x); (4) 

a + H(t,x,s) > V(a,s) <E D+ip(t,x); (5) 

Here we use the notions of nonsmooth analysis [4]. Sets D^(f{t,x) and D^pit,x) are called 
Dini sub differential and Dini superdifferential respectively. They are defined by following rules. 

D D p(t,x) = |(a,s)Glxl n : 

/ i i . . . (pit + olt, x + ag) - (pit,x) w . . _ n J 

ar + (s,g) < hmmf — — — rv ' V(r, j elxR , 

D+<p(t,x) = {(a,s)Glxl n : 

(p(t + ar,x + aq) — (p(t,x) , . TO „,! 

ar+ (s,g) > limsup— - — yy ' ' V(r, g) G R x R n \. 

a^o a ) 

The function ip is locally lipshitzian, since a is locally lipshitzian [3]. There exists a differen- 
tiability set of <p, denote it by J. We have J C (to,"^o) x K n . By the Rademacher's theorem [5] 
measure ([to, $o] x ^- n ) \ J is 0, therefore the closure of J is equal to [to, $o] X For (t, x) G J 
full derivative of p is (d<p(t, x) / dt, V<p(t, x)). If D^p>it, x) and D^ipit, x) are nonempty simulta- 
neously, then ip is differentiable at (t,x), and D^pit,x) = D^p>it,x) = {(d<p(t, x)/t, V<p(t, x))} 
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If (p is differentiable at position (t,x), then equality ([3]) is valid at the position (t,x) in the 
ordinary sense. 

Let (t,x) G [£q,#o] x R n - Consider the set 

^4y?(t, x) = { (a, s) : 3{(t h x i )}™ 1 C J : a = lim s = lim V^(tj, xt) 

I i— >oo (71 i— >oo 

Since </? is locally lipshitzian, the set A(p(t, x) is equal to Clarke subdifferential at the position 
(t,x) [4J. Therefore, we have [4| 

D^(p(t, x), D^cp(t, x) C A(p(t, x). (6) 

Let us describe the properties of Hamiltonian. 

First, let us introduce a class of real- valued function. This class will be used extensively 
throughout this paper. Denote by Q the set of all even semiadditive functions to : R — ► [0, +oo) 
such that uj{5) —* 0, 5 — > 0. 

If H = or H = then the following conditions are valid with T = Aj (see [2]): 

HI. (sublinear growth condition) for all (t, x, s) G M. n 

\H{t,x,s)\ <T||s||(l + ||x||); 

H2. for every bounded region Act™ there exist function uja G Q and constant La such that 
for all (t',x',s'),(t",x",s") G [t o ,0o] x A x M n , < R the following inequality 

holds: 

\\H{t' 1 x' 1 s')-H{t\x",s")\\ < 

< uj A (t' - t") + L A R\\x' - x"\\ + T(l + inf{\\x% \\x"\\})\\s x - s 2 ||; 

H3. if is positively homogeneous with respect to the third variable: 

H(t,x,as) = aH{t,x,s) V(t,x) G [t o ,0o] x Vs G W n Va G [0,oo). 

3 Main Result 

In this section we study the class of functions which may be a values of differential game. 
The main result is formulated below. 

Denote by COMP the set of all finite-dimensional compacts. Let P, Q G COMP, denote by 
DYN(P, Q) the set of all functions / : [t , $ ] x K n x P x Q — >• R n satisfying the conditions 
F1-F3. Denote by DYNI(P, Q) the set of all functions / : [t , i? ]xl n xPxQ^l n satisfying 
Isaacs condition and conditions F1-F3. The set of functions a : W 1 — > R satisfying condition 
El and E2 is denoted by TP. 

The set of values of differential games may be described in the following way. 
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• Set of values of differential games considered in the class counter-strategy/strategy is 

VALF = {if : [t ,M xl^R: 

BP, Q G COMP3/ G DYN(P, Q)Ba G TP : <p = Val f (•, •, P, Q, f, a)}. 

• Set of values of differential games considered in the class strategy/counter-strategy is 

VALS = {if : [t ,M xK"^l: 

BP, Q G C0MP3/ G DYN(P, Q)Ba G TP : <p = Val s (-, ■, P, Q, f, a)}. 

• Set of values of differential games considered in the class of feedback strategies is 

VAL1 = {if : [t , M x R n -> R : 

BP, Q G C0MP3/ G DYNI(P, Q)Ba G TP : <p = Val(-, ■, P, Q, f, a)}. 

Denote by Lip B the set of all locally lipschitzian functions ip : [to, i?o] x ^ n ~ * R such that 
V?(i?0j ') satisfies sublinear growth condition. The sets VALF, VALS, VALI are subset of the set 
Lip B . Also, VALI C VALF and VALI C VALS. 

Let ip G Lip B . Denote the differentiability set of (p by J. For (t,x) G J set 

x) 4 {V^(t,a;)}; 



fc(t,x,V^,x))4-?^M. (7) 



Put the following condition. 



(El) For any position (t*,x*) ^ J, and any sequences x")}^2 zl C J such 

that (t'ijx'j) — > (£*,x*), « — > oo, (t'-,x") — > (i*,x*), « — * oo, the following implication holds: 



dim V^,^) = lim V<p{t'l,x'l))^ 

(hm fcft,^, V^.xJ)) = lim V^C *?))). 



Let (f,ar) G [f o ,0 o ] x R™ \ J, denote 

E^x) = {s G R™ : Xi)} C J : lim Zj) = (t,x) & lim V X;) = s}. 

Since (p is locally lipschitzian, the set E\{t,x) is nonempty and bounded for every (t,x) G 
[t ,M xl"\ J. 

If (£,x) G [to,^o] x R™ \ J and s G Ei(t,x), then assumption (El) yield that the following 
value is well defined: 



h(t,x,s) = lim h(U,Xi,V(p(ti,Xi)) 

i— >oo 

V{(*i, Xi)}^ C J : lim {U, x t ) = (t,x)ks = lim V<^, Xi ). (8) 
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Condition (El) is the condition of extendability h from the set Eo = {(t, x, V</?(t, x)) : 
(t, x) G J} to E fl {(t, x, s) : (t, x) G [t , i? ] x R n \ ■/}■ Thus, function h is defined on the basis 
of Clarke sub differential of (p at (t, x) G (t , i? ) x R n \ Indeed, Clarke subdifferential of (p at 
(t, x) £ J is equal to 

„4</?(t,x) = co{(-/i(t,x, s), s) : s e £i(t,x)}. (9) 
Recall that for any (t, x) G (t , tf ) x R n 

£> D y?(t, x), £>f>(t, x) C „4</?(t, x). (10) 

Denote 

CJ- 4 {(t,x) E (*„,#„) xR n \J: D D p((t,x)) ^ 0}; 

CJ+ 4 {(t,x) G (f ,# ) xt n \J: D^((t,a;)) ^ 0}. 

Notice that CJ" n CJ + = 0. 

Define a set E 2 (t,x) for (t, x) G CJ~ by the rule: 

E 2 (t,x) = {s G R n : 3a G R : (a, s) G £> D y?((t, x))} \ E^t, x). 
If (t, x) G C J+ set 

£ 2 (t,x) = {s G K™ :3a Gl: (a, s) G D+ip((t, x))} \ E^t, x). 
If (t,x) G ([t ,#o] x K n ) \ (CJ~ U CJ + ) set 

£ 2 (t,x) 4 0. 

The set E 2 (t,x) is complement of Ei(t,x) with respect to projection of Dini subdifferential 
(or superdifferential) at (t,x). 
For (t,x) G [i ,i?o] x ^ n define 

E(t,x) = £i(t,x) U E 2 (t,x). 

E(t,x) ^ for any (t,x) G [t o ,0 o ] x W 1 . 

Let us introduce the following notations. If i = 1,2, then 

E, 4 {(*, s) : (f , x) G [t , #o] x M n , s G £ x (t, x)}. 

Denote 

E = {(t, x, s) : (t, x) G [t , #o] xK", s G £(t, x)}; 
E^ = {(t,x,s) : (t,x) G [t , A)] x M n , s G ^(M)}- 
Note that E^ C [t , tf ] 

x W 1 x S^™ Here S^ n 1 - ) means (n — l)-dimensional sphere 
S (n-i) A{ ser . || s || = x y 

Also, E = Ei UE 2 . 

Note, that the function h is defined on Ei. The truth of inclusion tp G VALF depends on 
the existence of this extension of h to E. 
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Theorem. Function if G Lip B belongs to the set VALF if and only if the condition (El) holds 
and the function h defined on Ei by formulas |7|) and (0|) is extendable to the set E such that 
conditions (E2)-(E4) are valid. ( Conditions (E2)-(E4) are defined below.) 

(E2) • If (t,x) G CJ~ then for any si,...s n+ 2 G Ei(t,s) X\, ...,A n+ 2 G [0,1] such that 
Y2 Afc = 1, (— X] ^kh(t, x, Sfc), AfcSfc) G D~(p(t, x) the following inequality holds: 

(n+2 \ n+2 

fc=l / fc=l 

• If (t,x) G CJ + then for any si,...s n+ 2 G Ex(t,s) Ai,...,A n+ 2 G [0,1] such that 
^2 Afc = 1, (— X] ^kh(t, x, Sfc), X] AfcSfc) G D + ip(t, x) the following inequality holds: 

(n+2 \ n+2 

fe=l / fc=l 

The condition (E2) is an analog of minimax inequalities (ED, (G3). 

(E3) For all (t,x) G [t ,t?o] x K n : 

• if G E(t, x), then h(t, x, 0) = 0; 

• if si G E(t,x) and S2 G E(t,x) are codirectional (i.e. (si,S2) = ||si|| • ||s2||)> then 

\\s 2 \\h(t,x, si) = ||si||/i(t,a;, s 2 ). 

This condition means that function ft, is positively homogeneous with respect to s. 

Let us introduce the function h\t, x, s) : -> K. Put V(t, a;) G [t , O ] xf" Vs G E(t, x)\{0} 

h\t,x, ||s||~V) = WsW^hit^^). (11) 

Under condition (E3) the function hr is well defined. 

(E4) • Function satisfies the sublinear growth condition: there exists T > such that for 
any (t, x, s) G the following inequality is fulfilled 

h\t,x,s) < r(i + ||x||). 

• For every bounded region A C R n there exist La > and function oja G Vl such 
that for any (f, x', s'), {t\ x", s") G E^ n [t , tf ] x A x R n the following inequality is 
fulfilled 

\\h\t\x\s')-h\t\x\s")\\ < cu A (t , -t")+L A ||x'-x"||+r(l+inf{||x / ||,||x"||})||s'-s // ||. 
Condition (E4) is a restriction of conditions HI and H2 on the set E. 

The proof of the main theorem is given in section 7. The proof uses lemmas formulated in 
sections 5 and 6. Let us introduce a method of extension of function h from Ei to the set E. 
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Corollary 1. Let tp G Lip B . Suppose that h defined on Ei by formulas |?P and (Q|) satisfies the 
condition (El). Suppose also that the extension of h on E 2 given by the following rule is well 
defined: V(t,s) G CJ _ U CJ + , s G E 2 (t,x) 

n+2 

h(t, x, s) = Xih(t, x, si) (12) 

i=l 

for any si, . . . , s n+2 G Ei(t,x), Xi,...,X n+2 st/c/i i/iai Aj = 1 X] = s - If function 
h : E — > R satisfies the conditions (E3) and (E4), i/ien G VALF. 

The following corollaries is devoted to the relations between sets VALF, VALS and VALI. 
Corollary 2. Sets VALF and VALS coincide. 
Corollary 3. If n = I, then VALI = VALF = VALS. 

The corollaries are proved in section 7. 



4 Examples 

First (positive) example. 

Let n = 2, t = 0, i? = 1- Consider the function 

(f 1 (t,Xi,X 2 ) = t+ \xi\ - \x 2 \. 

Let us show that ip 1 ^, •, •) G VALF. 

Function ip 1 is differentiated on the set 

J = {(t, x u x 2 ) G (0, 1) x R 2 : xi, x 2 ^ 0}. 

If (t, Xi, x 2 ) G J, then 

d(p 1 (t,x 1 ,x 2 ) 
dt 

Here sgnx means the sign of x: 



1, Vip 1 (t,x 1 ,x 2 ) = (sgnxi, -sgnx 2 ). 



sgnx 



1, x > 0, 
-1, x < 0. 



Therefore, if (9,g 1 ,g 2 ) G D^ip 1 ^, x±, x 2 ) UDp^ 1 (f,Xi,x 2 ), then = 1. 

Let us determine the set Ei(t, xi,x 2 ) C R n and function h}(t, x±, x 2 ; s±, s 2 ) for (t, x±, x 2 ) G J 
and (si,S2) G x±, x 2 ). The representation of J and formulas for partial derivatives of if 1 
yield the following representation of E(t, x±,x 2 ) and h}{t : xx,x 2 ) for (t,xi,£2) G J 

E 1 (t,x 1 ,x 2 ) = {(sgnxi, -sgnx 2 )}, 
h 1 (t,x l ,x 2 ; sgn^i, -sgnx 2 ) = -1. 
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Notice that condition (El) for ip 1 is fulfilled. Let (t,xi,X2) 4- J-> then 

{{(si, -sgnx 2 ) : |si| = 1}, xi = 0,a;2^0, 
{(sgnxi, s 2 ) : |s 2 | = 1}, xi 7^ 0,x 2 = 0, 
{(si, s 2 ) : |si| = |s 2 | = 1}, xi = x 2 = 0. 

If (t, Xi,x 2 ) 4- Ji then for (si,s 2 ) G Xi, x 2 ) put 

/i 1 (t,xi,x 2 ; si, s 2 ) = -1. 

Now let us determine D^ip 1 (t,x 1 ,x 2 ) and D^ip 1 ^, x±, x 2 ) for (t, Xi,x 2 ) ^ J. 
Let x 2 7^ 0, then 

^dV? 1 ^, 0,x 2 ) = {(1, si, -sgnx 2 ) : Sl G [-1,1]}, D^t, 0,ar 2 ) = 0. 

Indeed, function (p 1 has directional derivatives at points (t, 0,x 2 ) for x 2 7^ 0. In addition, 
derivative in the direction (r, gi,g 2 ) is 

, y? 1 ^ + ar,ii + £fia,x 2 + 5-2") - ip 1 (t,x 1 ,x 2 ) . . 

dy> (t,0,x 2 ;r, 51, ^2) = hm = r + #1 - 5r 2 sgna; 2 . 

We have, 

{(1, si, -sgnx 2 ) : si G [-1, 1]} = {(9, Si, s 2 ) : (6t + Si#i + s 2 g 2 ) < dip 1 ^, 0, x 2 ; r, #1, # 2 )} = 

= J D D V9 1 (t,0,x 2 ). 

Similarly, for x\ 7^ we have 

/J+y^x^O) = {(l,sgnxi,s 2 ) : Si G [-1,1]}, i^fo 0, x 2 ) = 0. 

Further, 

D^\t,0,0) = D D ip\t,0,0) = 0. 
Naturally, function ip 1 has directional derivatives at point (t, 0, 0) and 

rfv? 1 (t,a;i,x 2 ;r,5fi,5f 2 ) = r + |^| - \g 2 \. 

Suppose that 0,0) 7^ 0. If 

(9, si, s 2 ) G D^ 1 (i,a;i,X2), 

then 

si^i > \gi I V^i G R. 

This yields that s x > 1 and si < -1. Thus, D^ 1 ^, 0, 0) = 0. Similarly, D^ft 0, 0) = 0- 
Therefore, in this case 

CJ" = {(t, 0, x 2 ) G (0, 1) x I 2 : i 2 / 0}, 
CJ + = {(t, x±,0) G (0, 1) x R 2 : xi 7^ 0}. 
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We have 

{{(1, s x , -sgnx 2 ) : 8 X G [-1, 1]}, x 1 = 0,x 2 ^ 0, 

{(1, sgnxi, s 2 ) : si G [-1, 1]}, Xi ^ 0, x 2 = 0, 

0, XiX 2 7^ 0, or Xi = x 2 = 0. 

Use the corollary [1] to extend function h 1 to the set E 2 . Let (t,xi,x 2 ) G CJ~ U CJ + , s = 
(si,s 2 ) G E 2 (t,xi,x 2 ), put /^(t, xi, x 2 , si, s 2 ) = —1. Since for any s' = (s[,s 2 ) G Ei(t,Xi,x 2 ) 
h(t, xi,x 2 , s[, s 2 ) = — 1, one can suppose that h}(t, Xi, x 2 , si, s 2 ) is determined by (|T2l) . 

Notice that condition (E3) is fulfilled since for any position (t, xi,x 2 ) the set E(t, x%, x 2 ) 
doesn't contain codirectional vectors as well as vector (0,0). It is easy to check that condition 
(E4) holds. 

Second (negative) example. 

Let n = 2, t = 0, $ = 1. Let us show that 

<p 2 (t,x u x 2 ) =t(|xi| - \x 2 \) i VALF. 
Function <f 2 (-, •, •) is differentiated on the set 

J = {(t, Xi, x 2 ) G (0, 1) x R 2 : x x x 2 ^ 0}. 

We have 

dip 2 (t, xi, x 2 ) 2/ . 

— = xi - \x 2 , Vy? (t,Xi,x 2 ) = (t ■ sgnx 1; -t ■ sgnx 2 ) 

at 

for (£, Xi,x 2 ) G J. Thus, for (t,Xi,x 2 ) G J 

h 2 (t,x 1 ,x 2 ,t ■ sgnxi,t ■ sgnx 2 ) = -(|xi| - |x 2 |), 
Ei(t, x l} x 2 ) = (t ■ sgnxi, —t ■ sgnx 2 ). 

Further, if (t,x 1 ,x 2 ) G J, (si,s 2 ) G E(t,x), then ||(s 1 ,s 2 )|| = £\/2. Thus for [t,Xi,x 2 ) G J the 
following equality is fulfilled 

E*(t,x 1 ,X2) = (sgnxi/v^, -sgnx 2 /v / 2). 

One can check directly that the condition (El) holds in this case. Therefore we may suppose 
that h 2 (t, xi,x 2 ,si, s 2 ) is defined on Ei. Here we use formula (jHJ). 
Let us introduce the set E C (0, 1) x R 2 x R 2 . Put 

E = {(t, Xi, x 2 , t ■ sgnxi, —t ■ sgnx 2 ) : (t, Xi, x 2 ) G J}. 

By definition of E we have Eo C E. 

Suppose that there exists extension of the function h 2 satisfying the conditions (E2) and 
(E3). Hence the set 

Eg = {(t,Xi,x 2 ,sgnxi/v / 2, -sgnx 2 /v / 2) : (t, Xi,x 2 ) G J} 

is subset of E^. Further, the function (h 2 )^ is well defined on E . In this case 

{h 2 )\t, x 1 ,x 2 ,sgnx 1 /i/x~[,-sgnx 2 /V2) = 

Obviously, {h 2 f is unbounded on (0, 1) x A X W 1 nE5. Here A is any nonempty bounded subset 
of the set {(xi,x 2 ) G 1R™ : XiX 2 ^ 0}). Hence, condition (E4) does not hold for any extension 
of h 2 . Thus ip 2 i VALF. 
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5 Extension of h to the whole space 



This section is devoted to the extension of h to the space [to, $o] x M. n x R n . This result is 
based on McShane theorem about extension of range of function [6]. 

Lemma 1. Under conditions (E1)-(E4) function h : E — ► R can be extended to [to, $o] xR n xl" 
swc/i that the extension satisfies the conditions H1-H3. 

Proof. The extension of h is designed by two stages. First we extend function M : E 11 — > R to 
[ioj^o] x R n x S*^ -1 - 1 . Finally we complete a definition by positive homogeneously 

Let us define the function h* : [io,$o] x R n x S^ 71 ^ — > R. The function is designed 
to be a extension of hr. In order to define h* we design sequence of sets {G>}^ , G> C 
[ioj^o] x M n x S^' 1 ^, and sequence of functions {h r }^ , h r : G r — > R, possessing following 
properties. 

(Gl) G = E*, /io = 

(G2) G P _i C G r for all r G N. 

(G3) U r °° = oG r -fe4]xrx5M ; 

(G4) for every natural number r the restriction of h r on G>_i coincides with h r -i\ 
(G5) for any (t,x,s) G G r the following inequalities is fulfilled: 

\h r (t,x,s)\ < r(i + iisii), 

(G6) for every r G N and every bounded set A C R n there exist constant and 
function io A , r e such that for any (*', x' , s'), (t", x" , s") G G r n [i , #o] x A x S^™" 1 ) the 
following inequality is fulfilled: 

\h r {t' , x , s') — h r {t" , x" , s")\ < 

< uj Atr (t' - t") + L Ar \\x' - x"\\ + T(l + inf{||x'||, ||x"||})||s' - s"\\. (13) 

Here N = NU {0}. 

We define function h* in the following way: for every (t,x,s) G [to, $o] xR n x h*(t, x, s) = 
hi(t,x, s). Here I is the least number k G No such that {t,x, s) G Gk- 

Now let us define the sets G r . If x G R n , j G 1, n, then by x^ denote the j-th coordinate of 
x. By || • ||* denote the following norm of x: 

llxH* = max \x^\. 

j=l,n 

If x G R n , then 

\\ x \\* < INI- ( 14 ) 

Indeed, 
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Let e G Z n , let a G [0, oo). (Z means the set of integer numbers.) By H(e,a) denote n- 
dimensional cube with center at e and length of edge which is equal to a: 

n(e,o) = jxGR" : ||e-z||„ < |} . 

If a > 1, then 

]R n = (J n(e,a). 

Order elements e G Z n , such that the following implication holds: if ||e.j||* < ||efc||*, then i < k. 
Define the sequence {G r }£L by the rule: 

G 4 E\ G k 4 G fc _x U ([*o,0 o ] x n(e*, 1) x S^" 1 )) VA; G N. (15) 

We have 

[fo^olxrx^-^ |J G k . 

Thus conditions (GUJ)— (GJ3J) are fulfilled by definition. 
Now let us determine sequence of functions {h r }. Put 

ho(t, x, s) = h\t, x, s) V(t, x, s) G G = El 

Notice that for r = conditions (GJSJ) and (GJBJ) are fulfilled by (E4). 

Now suppose that function hk-i is determined on Gk-i such that conditions (G(5]) and (GJUJ) 
hold with r = k — 1. Let us determine function /i*. : Gk — > M. 

Denote by the constant L^-i in the condition (GED with A = H(ek, 3). We may assume 
that 

L k > r. (16) 

By Uk we denote the function uiA,k-i with A = II(efc, 3). 

Let (t,x,s) G Gk- For (t,x,s) ^ [to, $o] x n(efc, 1) x S^ -1 ) put h k (t,x,s) = h k -i(t,x, s). 
For (i,x,s) G [to,i?o] x n(e fc ,l) x put 

/ife(i, x, s) = max{— T(l + ||a;||), 

sup{A*_i(r,y,0 -w fe (t-r) - T(l + - f|| : 

(r, y, G G fc _x n ([t , M x n(e fc> 3) x S^)}}. (17) 

Let us show that the condition (G0J) is fulfilled for r = k. This means that h k (t,x,s) = 
h k -i(t, x, s) for (t, x, s) G G fc _i n ([t , #o] x n(e fc , 1) x S^" 1 )). We have 

sap{h k -i(T,y,£) - uj k (t - r) - T(l + ||x||) \\s - f|| : 

(r,y,0 G Gk-iH ([t ,tf ] x n(e fc ,3) X S^)} > h k ^(t,x,s) > -T(l + \\x\\). 

Hence, 

h k (t,x, s) = 8vp{h k -i{T,y,g) - uj k (t - r) - L k \\x - y\\ - Y{1 + ||x||)||s - £|| : 

(-r,y,£) G G k -i n ([t ,i?o] x n(e fe ,3) x S^ 1 ))} > /^(t, z, a). (18) 



12 



Let e > 0, let (r, y, £) G Gfc PI ([to, $o] x n(efc, 3) x S 1 ^ ^) be an element satisfying the inequality 

h k (t,x,s) < h k - 1 {T,y,£)-u] k (t-T)-L k \\x-y\\-r(l + \\x\\)\\s-Z\\+s. (19) 

Using ( TTBl) with r = A; — 1 and A = H(e k , 3), we obtain 

h k -i(r,y,0 - h k ^[t,x, s) < u k (t - r) + L k \\x - + T(l + inf{||x||, ||y||})||s - 

This and formula (fl9l) yield the following estimate: 

h k (t, x, s) - h k _i(t, x, s) < e. 

Since e is arbitrary we obtain that h k (t,x,s) < h k -i(t,x,s) for (t,x,s) G G k -i H ([to,^o] x 
n(efc, 1) xS 1 ^ -1 )). The opposite inequality is established above (see (fl8l)). Therefore, if (t, x, s) G 
Cfc-i fl ([to,^o] x n(efc, 1) x S^ n-1 )), then h k (t,x,s) = h k ^\(t,x,s). Thus function /i*, is an 
extension of hk-x- 

Moreover, one can prove the following implication: if (£, x, s) G G k -i fl ([to, $o] x n(efc, 3) x 
S^), then 

h k ^(t,x, s) = sup{/i fc _i(T,2/,f) - -r) - L fe ||a; - y|| - T(l + ||ac||)||s - f || : 

(r, y, G G fc _x n ([t , 0„] * n(e fc , 3) x S^ 1 ))}. (20) 

Let (t, x, s) G Gfc fl ([to,$o] x n(e&,3) x S^™ -1 )). We shall say that the sequence 
{(tj,a;i, s»)}~j C Gfc_i n ([t ,^o] x n(e fc ,3) x S' (n_1) ) realizes the value of h k (t,x,s), if 

h k (t,x, s) = lim [/i fc _i(ti,a;i, s») - ^(t - t») - - - T(l + ||x||)||s - s»||]. (21) 

If h k (t, x, s) > — r(l + ||x||), then at least one sequence realizing the value of h k (t, x, s) exists 
(seedlTD). 

Now we prove that h k satisfies the condition (G[5]) for r = k. Obviously, we may consider 
only triples (t, x, s) G [t , i?o] x n(efc, 1) x S^^K If /ifc(t, x, s) = —T(l + \\x\\), then the sublinear 
growth condition holds. Now let h k (t,x,s) > —T(l + \\x\\). Let sequence {(rj, yi, c 
Gk-i n ([to,^o] x n(efc,3) x S*™ -1 )) realize the value of h k (t,x,s). Using inequality ffT6j) we 
obtain 

hk-i(n,yi,£i) - LO k {t - n) - L k \\x - yi\\ - T(l + ||x||)||s - &|| < 

< r(i + \\ yi \\) - L k \\ x - Vi \\ < r(i + ||x||) + r||x - Vi \\ - L k \\x - Vi \\ < r(i + \\x\\). 

Consequently (seefTBj). the condition (Gj5]) holds for r = k. 

Let us show that h k satisfies the condition (Gj6j) for r = k. Let A be a bounded subset 
of R n , let {f,x',s'), {t",x",s") G ([t ,i?o] x A x S^- 1 )) n G fc . We estimate the difference 
h k (t',x',s')-h k (t",x",s"). 

Let us consider 3 cases. 

i. (t',x',s'), (t",x",s") ^[t ,^ ]xn(e fc ,l)x^- 1 ). 
Since h k (t,x,s) = h k -i(t, x, s) for (t,x,s) G G k \ [to,#o] x n(e*., 1) x S^™ -1 ), we have 

h k (t',x',s')-h k (t",x",s") < 

< UA,k-itf ~ t") + L A>k ^\\x' - x"\\ + r(l + M{\\x% - s"\\. (22) 
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ii. (t',x r ,s'), (t",x",s") e [to,i?o] x n(e fc ,3) x S^ 71 '^ and at least one triple is in [t ,#o] x 

From the definition of h k it follows that two subcases are possible. 

• h k (t',x',s') = — r(l + \\x'\\). In this case 

h k (t',x',s')-h k (t",x",s") < -r(i + ||x'||) + r(i + ||x"||) < r||x"-x'||. (23) 

• h k (t',x',s') > — r(l + Let the sequence {(tj, Xi, C Gfc-i fl ([t , i?o] x 
n(e fc ,3) x S( n -V) realize the value of h k (t' , x' , s'). By Q2DD for (t,x,s) = (t',x',s') 
and inequality ||s" — s'\\, \\s' — Sj|| < 2 we have 

h k -i(ti,Xi, Si) - u; k (t' - U) - L fe ||a;' - Xi\\ - T(l + \\x'\\)\\s' - Sj|| - h k (t",x", s") < 

< hk-^t^Xi, si) - u k (t' - ti) - L k \\x' - Xi\\ - r(l + - Sj||- 
- h k -i(ti,Xi, Si) + u k (t" - U) + L k \\x" - Xi\\ + r(l + ||a/'||)||s" - Sj|| < 

< u k (t' - t") + L k \\x' - x"\\ + T(l + ||x"||)(||s" - Si || - ||s' - Si \\)+ 

+ r(||xl-||x'||)||s / -si|| < 

< tu k (t' - 1") + L k \\x' - x"\\ + r(i + ||z"||)||s' - s"|| + 2r||x' - x"\\ < 

< u k (t' - t") + (L k + 4r)||x' - x"\\ + r(l + inf{||x'||, ||x"||})||s' - s"||. 

Hence, 

h k (t',x',s')-h k (t",x",s") < 

Mt' - t") + (L k + AV)\\x' - x"\\ + T(l + M{\\x% ||z"||})||s' - s"\\. (24) 

iii. One of triples (t',x',s r ), (t",x",s") belongs to [to, A)] x n(e fc , 1) x S^'^, and another 
triple doesn't belong to [t ,$o] x n(e fc ,3) x S^ 1 ^. 

Therefore, ||x' — x"\\ > \\x' — x"\\* > 1 (see (JHJ)). Since condition (G(5]) for r = k is 
established above, we have 

h(t',x', s') - h(t",x", s") < 2r(l + sup \\y\\) < 2T{1 + sup \\y\\)\\x' - x"\\. (25) 

yeA yeA 

The estimates yield that if (f, x 1 , s'), (t", x", s") E G k n ([to, $o] xAx ^ (n_1) ), then 

^(t',^,^)-^^',^'^") < ^ jfc (t / -t // )+i:A, fe ||x'-x /, ||+r(i+inf{||x , ||, llx"!)})!!^-^'!!. (26) 

Here ui A ,k is defined by the rule 

uJ Ak (5) = max{^ Ajfc „i(5),^ fc (5)} 
(one can check directly that uja,u £ the constant L A}k is defined by the rule 

L A:k = max <^ L Atk -i, L k + 4T, T(l + sup \\y\\) \ . 

I yeA J 
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Therefore the condition (G[6]) is fulfilled for r = k. 

This completes the designing of sequences {G>}£1 and {h r }^L satisfying the conditions 

((ID) ((H). 

For every (t, x, s) G [to, $o] xl"x S 1 *" -1 ) there exists number /c G N such that (i, x, s) G G^. 
Put 

h*(t,x,s) = hk(t,x,s). 

The value of h*(t,x,s) doesn't depend on number k satisfying the property (t,x, s) G Gk- By 
definition of hk (see (GED) we have 

h*(t,x,s) < r(l + ||x||). 

Let us prove that for every bounded set ici™ there exist function uja G Q and constant La 
such that for all (t',x',s'), (t",x",s") G [£o,$o] x Ax S^™" 1 ) the following estimate is fulfilled 

\h*(t',x',s')-h*(t",x",s")\ < cuA(t / -t /, ) + ^A||x / -x /, ||+r(l + inf{||x / ||,||x"||})||s , -s /, ||. (27) 
Indeed, there exists number m such that 



Ac |Jn(e fc ,i) 

fc=l 

By definition of {Gk} (see f lT5|) ) we have 

[to^olxAxSl"- 1 ) C [t ,^o]x 



fc=l 



Put = tUA,m, La — La,™,- Since h*(t,x,s) = h m (t,x,s) V(t,x,s) G [io,$o] x A x S^™ ^, the 
property (GED for r = m yields that 



|/i*(t\x^0-^ = \h m (t\x\s')-h m (t'\x\s")\ < 

< uj A , m (t' - t") + L Atm \\x' - x"\\ + T(l + M{\\x% \\x"\\})\\s' - S '' 



Thus, the inequality (|27|) is fulfilled. 

Now let us introduce the function H : [to,$o] x R n x 



I. Put 



H(t, x, s) 



\s\\h*{t,x, ||s|| _1 s), s^O 
0, s = 0. 



(28) 



Function H is an extension of h. Naturally, let (t, x, s) G E, s ^ 0. Then (t, x, ||s|| -1 s) G W^. 
Hence, 

H(t,x,s) = \\s\\h*(t,x, ||s|| _1 s) = ||s||/r(i, x, ||s|| _1 ||s||) = h(t,x,s). 
If (t, x, 0) G E, then by condition (E3) we have 

h(t,x,0) = = H{t,x,0). 
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Function H satisfies the condition H2. Let S\, s 2 G M. n , (t, x) G [to, $o] x Let us estimate 
\H(t, x, Si) — H(t,x,s 2 )\. Without loss of generality it can be assumed that ||si|| > ||s 2 ||. If 
||s 2 || = 0, then 



\H(t,x,s 1 )-H(t,x,s 2 )\ = \H(t,x,8!)\ < T(l 
Now let ||s 2 || > 0. 



rn 



\X ) Si - s 2 \ 



(29) 



\H(t,x,sx) - H(t,x,s 2 )\ 



\si\\h* ( t, x 



<(Pi-s 2 \ 



h* ( t, x, 



\si\ 



I Sl I 



s 2 



\s 2 \\h* ( t, x 



s 2 
\s 2 \ 



< 



h* ( t, x, 



Nil 



— h* ( t, x, 



_£2_ 

\s 2 \ 



< 



< r(i + \\x\\)\\ Sl - s 2 \\ + ||s 2 ||r(i + \\x\ 



s 2 



< 

\Sl\\ \\s 2 \' 

<2r(l + ||a;||)||s 1 -s 2 ||. (30) 

In order to prove the last estimate in (|30l) we need to show that if > ||s2|| then 

l S 2||Sl 



' S 'l 



S 2 



(31) 



Let z G M. n be a codirectional with si, let 7 be the angle between si and s 2 \ 

(si,s 2 ) 



cos 7 



l S l|| • ll S 2| 



Consider triangle formed by the origin and terminuses of z and s 2 . The lengths of side of 
triangle are ||z||, ||s2|| and ||z — S2\\- By the cosine theorem we have 

\\ z — s 2 \\ 2 = \\s 2 \\ 2 + ||z|| 2 — 2\\z\\ \\s 2 \\ COS7 = ||s 2 || 2 (l — cos 2 7) + (H^ll — ||s 2 || COS7) 2 . 

Hence, the function \\z — s 2 || as a function of ||z|| increases on the region \\z\\ > \\s 2 \\ COS7. Since 

l S 2||Sl 



PI 



l S 2|| < Sl , 



the estimate ([31]) holds. 

Combining estimates (129!) and (130]) we get 

\H{t,x,si) -H{t,x,s 2 )\ < T(l + ||x||)||si -s 2 || V(t,x) G [t ,M xM n Vsi,s 2 Gl 

Here T = 2r. Using the definition of H (see ( 1281) ). properties of function h* (see ([2 
obtain that function H satisfies the condition H2. 

Notice that for all (t, x, s) G [to, #0] x ]R n x R n the following inequality holds: 

| J ff(t,x,s)|<r||s||(l+||x||)<T|H|(l + ||a;||). 

This means that the function H satisfies the condition HI. 
Function H is positively homogeneous by definition. 
This completes the proof. 



(32) 
), we 



□ 
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6 Construction of Game with the Given Hamiltonian 



The following lemma is close to the result of L.C.Evans and P.E.Souganidis (see [?]) about 
construction of differential games. We consider unbounded, locally lipschitzian hamiltonians 
but in [7] only bounded on [to,^o] x IR n x S^ 1 ', uniformly lipschitzian hamiltonians are con- 
sidered. 

Lemma 2. Let function H : [to, $o] x K" x I™ -> 1 satisfy the conditions H1-H3. Then there 
exist sets P,Q G COMP and function f G DYN(P, Q) such that 

H(t,x,s) = maxmin{s, f(t,x,u,v)) V(t,x,s) G [to,#o] x IT x R n . (33) 

Proof. Denote 

B = {seR n : \\s\\ < 1}. 

By the condition H2 there exists a real number T, such that for all it, x, si), (t, x, S2) G [t , $0] x 
R n x R n the following estimate holds: 

\H{t,x, Sl )-H(t,x,s 2 )\ < T(l + HxIDUsi- sail- 
Therefore, 

H(t, x, s) = \\s\\H ( t, x, -—r- ) = max H(t, x, z) — T(l + ||x|| 

V S / z&B 



\s\\ max mm 

z£B y€B 



H(t,x,z) + T(l + \\x\\) (y }T1 r - z 



(H(t,x,z) + T(l + ||x||)) - T(l + ||x||) + T(l + \\x\\)(y, — - z 



= s max mm 

z£B y£B 

= maxmin[(if (t, x, z) + T(l + ||x||)|| s || + T(l + \\x\\){y, s) - T(l + ||x||)(l + (y, z))\\s\\] 

z£B y&B 

Since for all y,z G B 

H(t,x,z) + T(l + ||x||), T(l + ||x||)(l + (y,z)) > 0, 

it follows that 
Hit, x, s) = max min max min 

z€B y€B z'eB y'eB 

\(H(t, x, z) + T(l + ||x||))<y, s) + T(l + \\x\\)(y, s) + T(l + ||x||)(l + (y, z))(y', s)}. (34) 

In formula (1341 one can interchange min y& B and max z / e ^- Denoting P = Q = B x B, and 

f(t, x, u, v) 4 H(t, x, z)z' + T(l + \\x\\)[z' + y + (1 + (y, z))y'\, 

for (t,x) G [to 5^0] x JR n > u — (y,y'), v — ( z i z ') we obtain that (|33|) is fulfilled. By definition of 
/ it follows that / G DYN(P, Q). 

□ 
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Lemma 3. Let function H : [to, $o] x R" x R" ^ R satisfy the conditions H1-H3. Then there 
exist sets P, Q G COMP and a function f G DYN(P, Q) such that 

H(t, x, s) = min max(s, f(t, x, u, v)) V(t, x, s) G [t , i? ] x IR n x M n . 



s 

Ml ~ ^ 



Proof. 

H(t, x, s) = \\s\\ min H(t, x, y) + T(l + ||x|| 

y£B [ 

Then the proof is similar to the proof of previous lemma. □ 

Lemma 4. Let n — 1, H : [£o,#o] x I™ x R" -> R satisfy the conditions H1-H3. Then there 
exist sets P,Q G COMP and a function f G DYNI(P, Q) snc/i t/jat 

«,«)) 

V(t, x, s) G [t , #o] xR"x R n . (35) 



if (t, x, s) = max min(s, /(£, x, u,v)) = min max(s, f(t, x, u, v)) 



Proof. If s 7^ 0, then 
H(t,x,s)= max [i?(t, x, z)||s|| — T(l + ||a;||)(s, s — z)\ = 

z£{-l,l} 

= max min [H(t, x, z)\\s\\ + T(l + ||x||) llsll (y, s — z)\ = 
ze{-i,i}ye{-i,i} 

= max min [(H(t,x,z) + T(l + ||x||))||s|| + T(l + \\x\\)((y,s) - \\s\\((y,z) + 1))] = 
«e{-i,i}s/e{-i,i} 

= max min max min 

ze{-i,i} ye{-i,i} z'ef-1,1} y'€{-l,i} 

[(/T(t, x, z) + T(l + \\x\\))(z', s) + T(l + ||x||)(y, s) + T(l + ||x||)«y, z> + l)(y', s>] (36) 
Note that min^gj-i n and max 2 / G {_ 11 } are permutable. Denote 

g(t, x } y, y', z, z<) 4 (#(*, x, z) + T(l + ||x||))^ + T(l + ||x||)y + T(l + ||x||)((y, z) + l)y' . 
Thus, for s G M the following representation is fulfilled: 

H(t,x,s)= max min (s,g(t,x,y,y',z,z')). 

z,z>e{-l,l}y,y'e{-l,l} 

In addition, by (1361) and definition of g we obtain for s ^ the following representation: 
H(t,x,s)— max min (s, g(t,x,y,y', z, z')) — 

z,z> £{-1,1} y,y'e{-l,l} 

= max (s, x, — — ||,s|| _ s, z, z')) > min max (s,g(t,x,y,y',z,z')). 

z,z'e{-l,l} ' y,y'e{-l,l} z,z'e{-l,l} 

Therefore, for all s G M the following inequality holds 

H(t,x,s)= max min (s,g(t,x,y,y',z,z')) > min max (s,g(t,x,y,y',z,z')). 

z,z'e{-l,l} y,y'e{-l,l} ' y,y' e{-l,l} z,z'e{-l, 1} 

Opposite inequality is obvious. 

Denote P = Q = {-1, 1} x {-1, 1}, u = (y,y'), v = (z,z'), f(t,x,u,v) = g(t,x,y,y',z,z'). 
We have, / G DINI and 



H(t, x, s) = maxmin(s, f(t, x, u, v)). 



□ 
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7 Construction of the Differential Games whose Value 
Coincides with a Given Function 

In this section we prove the statements formulated in the section [31 

Proof of the Main Theorem. Necessity. 

Let <p> G Lip B n VALF. Then by definition of VALF there exist the sets P,Q G COMP, and 
the function / G DYN(P, Q), a G TP such that <p = Val f (-, -, P, Q, f, a). Therefore (see 0) (p 
is a minimax solution of the equation 

^ + H(t,x,V<p) = 



with 



H(t, x, s) = maxmin(s, f(t, x, u, v)). 



Consider the function h defined by formula (J7j) on J. Note that J means the set of differentia- 
bility of ip. We have 

h(t, x, s) = H(t, x, s), (t, x) G J, s G E(t, x). 
Let (t,x) be a position at which function ip is nondifferentiable, s G E\(t,x). Denote 

Lp(t, x, s) = {a G R : 3{(t h Xi )}Zi C J : 

(t,x, s) = lim (tj, Xj, V(p(ti, Xij) &a = lim dip(ti,Xi)/dt}. 

i— >oo t— >oo 

Since d(p(t,x)/dt = —H(t,x,Vcp(t,x)) for G J, the continuity if yields that 

Ly>(£, x, s) = {— H(t, x, s)}, (t,x)<£J, s<EE 1 (t,x). 

Thus function h = H satisfies the condition (El). In addition, function h(t,x,s) = H(t,x,s) 
is determined by jSJ) for (t,x) J, s G Ei(t,x). We have that h — H on Ei. 

Set the extension of /i to E 2 to be equal to H. Since ip is minimax solution of Hamilton- 
Jacobi equation, we get that for all (t,x) G [<oj$o] x ^ n the following inequalities hold 

a + H(t, x, s) < V(a, s) G D~<p(t, x). 

a + x, s) > V(a, s) G D + ip(t, x). 

If function ^ is not differentiable at (t,x) and D~ip(t,x) U D + ip(t,x) ^ 0, then either (t,x) G 
CJ~ or (£, x) G CJ + . Let (i, x) G CJ~. Consider Ai, . . . \ n +2 G [0, 1] and S\, . . . , s n+ 2 G E\(f, x) 
such that \ = 1 an d 



n+2 n+2 

X k H(t,x, s k ),^2\ k s k ) eD~(t, 

k=l k=l 



X 



Therefore, 



n+2 / n+2 

- A*Pf (t, x, s k ) + H I £, x, ^ A fc s fc ) < 0. 

fc=i V fc=i 
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Similarly, if (t, x) G CJ + , Ai, . . . X n +2 G [0, 1] and si, . . . , ■s n+ 2 G -Ea(t, x) satisfy the conditions 

n+2 n+2 \ 

^2 hH(t, X, S k ), ^ ^kS k ) e £> + (t, x), 
fc=l fc=l / 

then the following inequality is fulfilled: 

n+2 / n+2 \ 

- ^ ^kH{t, X, S k ) + H I t, X, A fc S fc J > 0. 

fc=l V fc=l / 

We get that function h = H satisfies the condition (E2). 

The condition (E3) holds since H is positively homogeneous. Note that h\t,x,s) = 
H(t,x,s) W(t,x,s) G Er. Since H satisfies the conditions HI and H2, condition (E4) is ful- 
filled also. 

□ 

Proof of the Main Theorem. Sufficiency. 

Consider the function h is defined on Ei by formulas (J7J) and (jHJ). By the assumption there 
exists the extension of h to E which satisfies the conditions (E2)-(E4). By lemma Q] there exists 
the function H : [t , $o] x R" x I" -» 1 which is extension of h and satisfies the conditions 
H1-H3. By lemma [2] there exist compacts P,Q G COMP and function / G DYN(P, Q) such 
that 

H(t, x, s) = maxmin(s, f(t, x, u, v)). (37) 

Put 

a{x)^p{d 0) x). (38) 

Since cp G Lip B , we get a G TP. Let us show that ip = VaP{-, ■, P,Q, f,a). This is equivalent 
to the requirement that cp satisfies the conditions (j2J), © and (jSJ). 

Obviously, the boundary condition (j2J) is valid by definition of a. Let us show that ip the 
conditions (jlj) and (jSJ) are valid. 

If (t,x) G J, then D~(p(t,x) = D+cp(t,x) = {(d<p(t,x)/dt,V<p(t,x))} 

= -h(t,x,V(p(t,x)) = -H(t,x,V(p(t,x)). 

Therefore, for (t, x) G J the inequalities (jlj) and (jSJ) hold. 

Now consider (t,x) J. By the properties Clarke sub differential and function h (see ([9]), 
(fTOl)) it follows that 

D^ip(t,x), D^<p(t,x) C co{(— h(t, x, s), s) : s G i?i(t, x)}. (39) 

If (a,s) G D^(p(t,x) (in this case (i,x) G CJ~), then there exist Ai,...,A n+ 2 G [0,1], 
si, . . . , s n+2 G x) such that ^ A fc = 1, = s, - J2 ^kh{t, x, s k ) = a (see ([39])). Using 

condition (E2) we obtain 

h(t,x,s) < Afcfe(t, x, gfc) = —a. 
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This is equivalent to the condition (j3J). Similarly the truth of (jSJ) can be proved. Thus, <p 
is minimax solution ([3]) with boundary condition (j2J). By [2] and fl371) it follows that tp = 
VaV *(•, ■, P,Q, f,a). This completes the proof. 

□ 

Proof of CorollaryUi The condition (El) is valid by the assumption. If (i, x) G CJ~, s G 
E 2 (t,x), then for any Ai, . . . A n+2 G [0, 1], Si . . . , s n+2 such that ^ A fc = 1, X] -^fc s fc = s, the 
following inclusion holds: 

n+2 n+2 



^2\ k h(t,x,s k ),^2\ k s k ) eD ip(t,x). 



k=l k=l 

By assumption 

n+2 

h(t,x,s) = ^\ k h(t,x, s k ). 

k=l 

Therefore the first part of condition (E2) is fulfilled. In the same way the second part of (E2) 
can be proved. The conditions (E3) and (E4) hold by assumption. Therefore (p G VALF. 

□ 

Proof of Corollary® Let <p G VALF. There exist sets P,Q and function / G DYN(P, Q), 
a G TP such that yj = VaP '(-, -, P,Q, f, a). By lemma [3] there exist sets P',Q' G COMP and 
function /' G DYN(P, Q) such that for any (t,x) G [to,$o] x s 6 R" the following equality 
holds: 

maxmin(s, fit, x, u, v)) = Hit, x, s) = min max(s, fit, x, u, v)). 
Consequently, p = Val s (-, ■, P\ Q', f, a) G VALS. Thus, 

VALF C VALS. 

The opposite inclusion is proved in the similar way. □ 
Proof of Corollary Obviously, 

VALI c VALF = VALS. 

We shall prove that if n = 1 then 

VALF c VALI. (40) 

Let (p G VALF. By definition of VALF there exist sets P,Q G COMP and functions / G 
DYN(P, Q), a G TP such that 

<p = Val'(.,.,P,Q,f,o-). 
By lemma H there exist sets Pi,Qi G COMP and function f x G DYNI(P, Q) such that 

min max(s, fi(t, x, u, v) = H(t, x, s) = maxmin(s, fit, x, u, v)). 
Thus ip = Val(-, ■, Pi, Qi, fi, a). Therefore, the inclusion (|4"0"]) holds. □ 
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